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Abstract — Interconnected dynamic systems are a pervasive 
component of our modern infrastructures. The complexity of 
such systems can be staggering, which motivates simplified 
representations for their manipulation and analysis. This work 
introduces the complete computational structure of a system as 
a common baseline for comparing different simplified represen- 
tations. Linear systems are then used as a vehicle for comparing 
and contrasting distinct partial structure representations. Such 
representations simplify the description of a system's complete 
computational structure at various levels of fidelity while re- 
taining a full description of the system's input-output dynamic 
behavior. Relationships between these various partial structure 
representations are detailed, and the landscape of new realization, 
minimality, and model reduction problems introduced by these 
representations is briefly surveyed. 

I. Introduction 

Structure and dynamic behavior are two of the most fun- 
damental concepts characterizing a system. The interplay 
between these concepts has been a central theme in control 
as far back as Black's, Bode's, or Nyquist's work on feedback 
amplifiers (D, 0, 0, or even as early as Maxwell's analysis 
On Governors in 1868 0. 

The key property driving such analyses is the fact that 
an interconnection of systems yields another system. This 
property suggests a natural notion of structure, as the inter- 
connection of systems, and focuses attention on understanding 
how interconnections of different systems result in varieties of 
dynamic behaviors. 

This idea of structure as interconnection is not only critical 
in the analysis of systems, but it also plays a key role in system 
modeling. While black box approaches to modeling seek to 
duplicate the input-output behavior of a system irrespective 
of structure, first principles approaches to modeling use the 
visible interconnection structure of a system to decompose 
the system into smaller, fundamental components. Constitutive 
relations describing each of these components are then applied, 
and interconnection principles linking these relations then 
result in a model structurally and dynamically consistent with 
the original system. 

While such approaches have demonstrated remarkable suc- 
cess in electrical and mechanical domains where system 
components are readily visible and physically separated from 
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each other 0, 0, Q, application of such methods to bi- 
ological, social, and other domains has been more difficult. 
One reason may be that these systems do not exhibit a natural 
structure in the same sense that previous applications have; 
while components of electrical and mechanical systems are 
compartmentalized and solid-state, the physical relationship 
among components of these other systems are often much 
more fluid 0, 0. Perhaps for these other domains different 
notions of structure play the role historically occupied by the 
interconnection of components. 

This paper explores these ideas by characterizing the com- 
plete computational structure of a system and then contrasting 
it with three distinct partial structure representations. These 
different representations include the interconnection of sub- 
systems and the standard idea of a transfer function matrix, 
but it also includes a newer concept of system structure called 
signal structure that appears to be especially useful for charac- 
terizing systems that are difficult to compartmentalize. Precise 
relationships between these various perspectives of system 
structure are then provided, along with a brief discussion on 
their implications for various questions about realization and 
approximation. 

II. Complete Computational Structure 

The complete computational structure of a system char- 
acterizes the actual processes it uses to sense properties of 
its environment, represent and store variables internally, and 
affect change externally. At the core of these processes are 
information retrieval issues such as the encoding, storage, 
and decoding of quantities that drive the system's dynamics. 
Different mechanisms for handling these quantities result in 
different system structures. 

Mathematically, state equations, or their generalization as 
descriptor systems fTOlL ATI . fT2) are typically used to 
describe these mechanisms. Although there may be many 
realizations that describe the same input-output properties of a 
particular system, its complete computational structure is the 
architecture of the particular realization fundamentally used 
to store state variables in memory and transform system inputs 
to the corresponding outputs. In this work we will focus our 
attention on a class of differential algebraic systems that are 
equivalent to a set of ordinary differential equations in state 
space form; we will refer to such equations as generalized 
state equations. 

Representing a system's complete computational structure 
is thus a question of graphically representing the structure 
implied by the equations that govern its state evolution. In 



this work, rather than focusing on the specific syntax of any 
one particular graphical modeling language, we will draw from 
the standard system theoretic notions of a block diagram and 
a signal flow graph to conduct a concrete analysis between 
graphical representations of a system at various levels of 
abstraction. The complete computational structure of a system, 
then, is the description of the system with the most refined 
resolution, which we will characterize as a graph derived from 
a particular block diagram of the generalized state equations. 

To make this concept of structure precise, we begin by 
considering a system G with generalized state space realization 
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f(x,w, w), 
h(x,w,u). 



(1) 



Note that this system is in the form of a differential algebraic 
equation, although we will only consider systems with differ- 
entiation index zero, implying that ([T]) is always equivalent 
to a standard ordinary differential or difference equation of 
the same order fT3ll . Typically we may consider the system 
([T]) to be defined over continuous time, with t G M > 0, and 
with u G M m , x Gi", w G R l , y e and x taken to mean 
dx/dt. Moreover, we restrict our attention to those functions 
/, g and h where solutions exist for t > 0. Nevertheless, we 
could also consider discrete time systems, with t = 0, 1,2,3, ... 
and x in |T]) taken to mean x[t + 1], or systems with general 
input, state, auxiliary, and output spaces fy, 3£ , W , or & , 
respectively. In some situations these "spaces" may merely 
be sets, e.g. 3E = {0, 1}. In any case, however, we will take 
u G x G & n , w G WK and y G & p so that m, n, I and p 
characterize the dimensions of the input, state, auxiliary and 
output vectors, respectively. 

Note that the auxiliary variables, w, are used to characterize 
intermediate computation in the composition of functions. 
Thus, for example, we distinguish between f(x) = x and 
f(x) = 2(.5jc) by computing the latter as f(w) = 2w and 
w = g(x) = .5x. In this way, the auxiliary variables serve to 
identify stages in the computation of the state space realization 
([if. Frequently we may not require any auxiliary variables in 
our description of the system; indeed it is the standard practice 
lf]~4l to eliminate auxiliary variables to simplify the state 
descriptions of systems. Nevertheless, as we discuss structure, 
it will be critical to use auxiliary variables to distinguish 
between systems with dynamically equivalent, yet structurally 
distinct architectures, leading to the following definition. 

Definition 1: Given a system ([I]), we call the number of 
auxiliary variables, /, the intricacy of the realization. 

To understand the structure of (p}, we need a notion of 
dependence of a function on its arguments. For example, the 
function f(x,y,z) = xy — x + z clearly depends on z, but it 
only depends on x when y ^ \ (or on y when x ^ 0). Since 
"structure" refers at some level to the dependence of the 
system variables on each other, it is important that our notion 
of dependence be made clear. 

Definition 2: A function f(w), from /-dimensional domain 
W to s-dimensional co-domain S \ is said to depend on the 



jtn variably w . ? if there exist values of the other s — 1 variables 
Wj, j 7^ i, such that f(w) is not constant over all values of w/ 
while holding the others variables fixed. If s = 1, then f(w) 
depends on w if it is not constant over all values of w. 

Note that when df/dwi is well defined, the above definition 
coincides with the partial derivative being non-zero for some 
value of the variables Wj. Nevertheless, here we allow for 
non-differentiable functions as we explicitly characterize one 
notion of the structure of a state space realization. 

Definition 3: Given a system G with realization ([I]), its 
complete or computational structure is a weighted directed 
graph ^ with vertex set Vffi), and edge set E(f£). The vertex 
set contains m + n + / + p elements, with one for each input, 
state, auxiliary, and output variable of the system; we label the 
vertices accordingly. In particular, the vertex associated with 
the i th input is labeled Ui, 1 < i < m, the vertex associated 
with the j th state is labeled fj,0<j< n, the vertex associated 
with the k th auxiliary variable is labeled gk, 0<k<l, and the 
vertex associated with the V th output is labeled h r , 1 < r < p. 
The edge set contains an edge from node i to node j if the 
function associated with the label of node j depends on the 
variable produced by node i. Moreover, the edge (/, j) is then 
labeled (weighted) with the variable produced by node i. 

So, for example, consider the following continuous time 
system with real- valued variables: 
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Its complete computational structure has node 
set V(&) = {u,fij 2 ,g,h} and edge set E(tf) = 
{u(uji),xi(fiji),xi(fij2),x 2 (f2,g),x 2 (f2,h),w(gji)}; 
Figure [T] illustrates the graph. 

This notion of the complete computational structure of 
the system ([T]) corresponds with the traditional idea of the 
structure of a dynamic system (see for example (HJ, lfT6l ). but 
with some important differences. First, this description uses 
auxiliary variables to keep track of the structural differences 
introduced by the composition of functions. This allows a 
degree of flexibility in how refined a view of the computational 
structure one considers "complete." Also, this description may 
have some slight differences in the labeling of nodes and 
edges compared with various descriptions in the literature fT5lL 
El, lfT8l . |[T9lL fT4l . These differences will become important 
as new notions of partial structure are introduced in later 
sections. Here, we use rectangular nodes for graphs where 
the nodes represent systems, and the associated edges will 
represent signals. This convention will bridge well between 
the graphical representation of system structure and the typical 
engineering block diagram of a system, and it sometimes 
motivates the simplification in drawing edges as shown in 



Figure |l(b)| ), since every edge that leaves a node represents 
the same variable and carries the same label. Moreover, notice 
that nodes associated with the mechanisms that produce output 
variables are terminal, in that no edge ever leaves these nodes, 
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(a) The complete computational structure 
specified by equation |2j. 



of the simple example 
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(b) A modified representation of the complete computational structure of 
the system specified by equation j2j. Since the edges leaving a particular 
node will always represent the same variable, they have been combined 
to simplify the figure. 

Fig. 1. The complete computational structure of the state realization of a 
system is a graph demonstrating the dependency among all system variables; 
edges correspond to variables and nodes represent constitutive mechanisms 
that produce each variable. System outputs are understood to leave the 
corresponding terminal nodes, and system inputs arrive at the corresponding 
source nodes. 



while the nodes associated with input variables are sources, 
in that no edge ever arrives at these nodes. Although it is 
common for engineering diagrams to explicitly draw the edges 
associated with output variables and leave them "dangling," 
with no explicit terminal node, or to eliminate the input 
nodes and simply depict the input edges-also "dangling," our 
convention ensures that the diagram corresponds to a well 
defined graph, with every edge characterized by an ordered 
pair of nodes. Note also that state nodes, such as f\ in Figure 
[T] may have self loops, although auxiliary nodes will not, 
and at times it will be convenient to partition the vertex set 
into groups corresponding to the input, state, auxiliary, and 
output mechanisms as V(tf) = {V u (&) , V x (&) , V w (#) , V y (#) } . 
Likewise, we may similarly partition the edge set as necessary. 

We see, then, that knowing the complete structure ^ of 
a system is equivalent to knowing its state space realiza- 
tion, along with the composition structure with which these 
functions are represented, given by (f,g,h). We refer to this 
structure as computational because it reveals the dependencies 
among variables in the particular representation, or basis, that 
they are stored in and retrieved from memory. These spe- 
cific, physical mechanisms that store and retrieve information, 
identified with V x (^), are interconnected with devices that 
transform variables, identified with V w (^), and with devices 
that interface with the system's external environment. These 
devices include sensors, identified with V u (^) 9 and actuators, 
identified with V y (^), to implement the particular system 



behavior observed by the outside world through the manifest 
variables, u and y. Although other technologies very well 
may implement the same observed behavior via a different 
computational structure and a different representation of the 
hidden variables, x and w, ^ describes the structure of the 
actual system employing existing technologies as captured 
through a particular state description. In this sense, is 
the complete architecture of the system, and often may be 
interpreted as the system's "physical layer." Importantly, it is 
often this notion of structure, or a very related concept, that 
is meant when discussing the "structure" of a system, as the 
next example illustrates. 

A. Example: Graph Dynamical Systems 

As an example, we examine the computational structure of a 
graph dynamical system (GDS). Graph dynamical systems are 
finite alphabet, discrete time systems with dynamics defined in 
terms of the structure of an associated undirected graph. They 
have been employed in the study of various complex systems 
|2Q|, ED, including 

• Dynamical process on networks: 

- disease propagation over a social contact graph, 

- packet flow in cell phone communication, 

- urban traffic and transportation; 

• Computational algorithms: 

- Gauss-Seidel, 

- gene annotation based on functional linkage net- 
works, 

- transport computations on irregular grids; 

• Computational paradigms related to distributed comput- 
ing. 

Here we observe that the computational structure of the graph 
dynamical system corresponds naturally with the system's 
underlying graph. 

Given an undirected graph with vertex set V(&) = 
{1,2, a GDS associates with each node i a state x\ 

that takes its values from a specified finite set 3£ . This state 
is then assigned a particular update function that updates its 
value according to the values of states associated with nodes 
adjacent to node i on <S . Notice that this restriction on the 
update function suggests that the update function for state i 
depends on states consistent with the structure of indicating 
that the system's computational structure ^ should correspond 
to the adjacency structure of <3 , 

The distinction is made between a GDS that updates all of 
its states simultaneously, called a parallel GDS, and one that 
updates its states in a particular sequence, called a sequential 
GDS. The parallel GDS thus becomes an autonomous dynam- 
ical system, evolving its state according to its update function 
from some initial condition. The sequential GDS, on the other 
hand, can be viewed as a controlled system that receives a 
particular permutation of the node set V(Sf ) as input and then 
evolves its states accordingly. 

To illustrate, consider the sequential GDS given by & = 
{1,2,3,4} as indicated in Figure [2] Let = {1,2,3,4} and 
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(a) Undirected graph ^ defining the sequential Graph Dynamical 
System {3}. 




(b) Computational structure 
System {3}. 



of the sequential Graph Dynamical 



Fig. 2. Graph Dynamical Systems are finite alphabet discrete time systems 
with dynamics defined in terms of the adjacency structure of a specified 
undirected graph. Here we note that the computational structure of the system 
reflects the structure of its underlying graph. 



^" = ^ = {0,1}, with update function given by 
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/,(*,«)- 1 (i +Jc . )(1+Jc ._ l)(1 
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(4) 



and the arithmetic in ^ is taken modulo 2, while that in the 
subscript notation is taken modulo 4 (resulting in x$ = x\, etc.). 
So, for example, the initial condition x[0] = [0 0] r with 
input sequence u[t] = 1,2,3,4,1,2,3,4,... would result in the 



following periodic trajectory: 
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jc[3] = [101 0] r 
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jc[8] = [0 1] r 


x[28] 


= [0 0] r 



The computational structure of the system ^ follows im- 
mediately from the dependency among variables characterized 
by equation Q; Figure [2] illustrates ^ for this system. Notice 
that the structure of £f is reflected in ^ , where the undirected 
edges in £f have been replaced by directed edges in both 
directions, and self-loops have appeared where applicable. 
Moreover, notice that ^ considers the explicit influence of 
the input sequence on the update computation, and explicitly 
identifies the system output. In this way, we see that the 
computational structure is a reflection of the natural structure 
of the sequential GDS. 

B. Computational Structure of Linear Systems 

Linear systems represent an important special case of those 
described by ([T]). They arise naturally as the linearization of 
sufficiently smooth nonlinear dynamics near an equilibrium 
point or limit cycle, or as the fundamental dynamics of 
systems engineered to behave linearly under nominal operating 
conditions. In either case, knowing the structure of the relevant 
linear system is a critical first step to understanding that of the 
underlying nonlinear phenomena. 

The general state description of a linear system is given by 



x = Ax+Aw + Bu, 
w = Ax+Aw + Bu, 
y = Cx + Cw + Du, 



(5) 



where A e R nxn , A e R nx K A e R lxn , A G M /x/ , B e R nxm , 
B e M /Xm , C e W xn , C e R pxl , and D e R pxm . Note that 
I— A is necessarily invertible, ensuring that the differentiability 
index of the system is zero. Nevertheless, the matrices are 
otherwise free. 

As in the nonlinear case, it should be apparent that the 
auxiliary variables are superfluous in terms of characterizing 
the dynamic behavior of the system; this idea is made precise 
in the following lemma. Nevertheless, the auxiliary variables 
make a very important difference in terms of characterizing 
the system's complete computational structure, as illustrated 
by the subsequent example. 

Lemma 1: For any system Q with intricacy / > 0, there 
exists a unique minimal intricacy realization (A 0l B 0l C 0l D ) 
with / = such that for every solution (u(t),x(t),w(t),y(t)) 
of ([5]), (u(t),x(t),y(t)) is a solution of {A 01 B ,C ,D ). 

Proof: The result follows from the invertibility of (I— A). 
Solving for w and substituting into the equations of x and y 
then yields (A ,B ,C 0J D ). ■ 
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Consider, for example, the system §5§ with state matrices 
given by D = and the following: 
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(6) 

This system has the complete computational structure ^ 
shown in Figure |3(a)| Here, because each auxiliary variable 
is defined as the simple product of a coefficient times another 
variable, we label the node corresponding to w ; in ^ with the 
appropriate coefficient rather than the generic label, gf. Note 
that this realization has an intricacy of / = 8. 

Suppose, however, that we eliminate the last six auxiliary 
variables, leading to an equivalent realization with intricacy 
1 = 2. The state matrices then become 
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(7) 



with computational structure ^ as shown in Figure |3(b) 
Similarly, we can find an equivalent realization with / = 
given by 
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(8) 

and all other system matrices equal to zero. This realization, 
([5]), is the minimal intricacy realization of both systems ([6]) 
and ([7]), and its complete computational structure ^ is given 
in Figure |3(c)| The equivalence between these realizations is 
easily verified by substitution. 

Comparing the computational structures for different real- 
izations of the same system, ([6]), ([7]), and ([8]), we note that 




(a) The complete computational structure ' 
by the state matrices {6} with intricacy / = 



of the linear system given 




(b) The complete computational structure ^ of the equivalent linear 
system with intricacy / = 2, specified by the realization {7|. 




(c) The complete computational structure ^ of the minimal intricacy 
(/ = 0) realization for both systems above, characterized by J8j. 

Fig. 3. The complete computational structure of a linear system characterized 
by realizations of differing intricacies. Edges within shaded regions represent 
hidden variables, while those outside shaded regions are manifest variables. 



the intricacy of auxiliary variables plays a critical role in 
suppressing or revealing system structure. Moreover, note that 
auxiliary variables can change the nature of which variables 
are manifest or hidden. In Figure [3] shaded regions indicate 
which variables, represented by edges, are hidden; manifest 
variables leave shaded regions while hidden variables are con- 
tained within them. Note that the minimal intricacy realization 
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has no internal manifest variables, or, in other words, it has A. Subsystem Structure 



a single block of hidden variables (Figure 3(c) ). Meanwhile, 
both w\ and W2 are manifest in the other realizations (Figures 
3(a) 3(b)| ) since w\ = y\ and W2 = yi, indicated by the "1" at 
their respective terminal nodes. This yields two distinct blocks 
of hidden variables, in either case, revealing the role intricacy 
of a realization can play characterizing its structure. 

The complete computational structure of a system is thus 
a graphical representation of the dependency among input, 
state, auxiliary, and output variables that is in direct, one- 
to-one correspondence with the system's state realization, 
generalized to explicitly account for composition intricacy. All 
structural and behavioral information is fully represented by 
this description of a system. Nevertheless, this representation 
of the system can also be unwieldy for large systems with 
intricate structure. 



III. Partial Structure Representations 

Complex systems are often characterized by intricate com- 
putational structure and complicated dynamic behavior. State 
descriptions and their corresponding complete computational 
structures accurately capture both the system's structural and 
dynamic complexity, nevertheless these descriptions them- 
selves can be too complicated to convey an efficient under- 
standing of the nature of the system. Simplified representations 
are then desirable. 

One way to simplify the representation of a system is to 
restrict the structural information of the representation while 
maintaining a complete description of the system's dynamics. 
The most extreme example of this type of simplified represen- 
tation is the transfer function of a single-input single-output 
linear time invariant (LTI) system. A transfer function com- 
pletely specifies the system's input-output dynamics without 
retaining any information about the computational structure of 
the system. For example, consider the n th order LTI single- 
input single-output system given by (A,Z?,c,d). It is well 
known that although the state description of the system com- 
pletely specifies the transfer function, G{s) = c(sl —A)~ l b + d, 
the transfer function G(s) has an infinite variety of state 
realizations, and hence computational structures, that all char- 
acterize the same input-output behavior. That is, the structural 
information in any state realization of the system is completely 
removed in the transfer function representation of the system, 
even though the dynamic (or behavioral) information about 
the system is preserved. 

We use this power of a transfer function to obfuscate 
structural information to develop three distinct partial- structure 
representations of an LTI system: subsystem structure, signal 
structure, and the sparsity pattern of a (multiple input, multiple 
output) system's transfer function matrix. Later we will show 
how each of these representations contain different kinds of 
structural information, and we will precisely characterize the 
relationships among them. 



One of the most natural ways to reduce the structural infor- 
mation in a system's representation is to partition the nodes 
of its computational structure into subsystems, then replace 
these subsystems with their associated transfer function. Each 
transfer function obfuscates the structure of its associated 
subsystem, and the remaining (partial) structural information 
in the system is the interconnection between transfer functions. 

Subsystem structure refers to the appropriate decomposition 
of a system into constituent subsystems and the interconnec- 
tion structure between these subsystems. Abstractly, it is the 
condensation graph of the complete computational structure 
graph, ^ , taken with respect to a particular partition of ^ 
that identifies subsystems in the system. Such abstractions 
have been used in various ways to simplify the structural 
descriptions of complex systems (T5lL (22), for example by 
"condensing" strongly connected components or other groups 
of vertices of a graph into single nodes. Nevertheless, in 
this work we define a particular condensation graph as the 
subsystem structure of the system. We begin by characterizing 
the partitions of ^ that identify subsystems. 

Definition 4: Given a system G with realization Q and as- 
sociated computational structure ^ , we say a partition of V (ff) 
is admissible if every edge in E(^) between components of 
the partition represents a variable that is manifest, not hidden. 

For example, considering the system ([8} with 
V(^) = {wi,/i,ci,C2,/2, ^2}. We see that the partition 
{(mi), (/i,ci,C2j/2)> ("2)} is admissible since the only edges 
between components are u\{u\,f\) and U2(u2,fi), representing 
the manifest variables u\ and U2. Notice that the shading 
in Figure |3(c)| is consistent with this admissible partition. 
Alternatively, the partition { (u\ ) , (f\ , c\ ) , (c2, fi) , (^2) } is not 
admissible for since the edges xiC/1,/2) and X2C/2,/i) 
extend between components of the partition but represent 
variables x\ and X2 that are hidden, not manifest. 

Although sometimes any aggregation, or set of fundamental 
computational mechanisms represented by vertices in ^, may 
be considered a valid subsystem, in this work a subsystem 
has a specific meaning. In particular, the variables that inter- 
connect subsystems must be manifest, and thus subsystems 
are identified by the components of admissible partitions of 
y(^). We adopt this convention to 1) enable the distinction 
between real subsystems vs. merely arbitrary aggregations of 
the components of a system, and 2) ensure that the actual 
subsystem architecture of a particular system is adequately re- 
flected in the system's computational structure and associated 
realization, thereby ensuring that such realization is complete. 

Definition 5: Given a system G with realization ^ and 
associated computational structure ^ , the system's subsystem 
structure is a condensation graph of ^ with vertex set 
V(y) and edge set E(y) given by: 

• V(y) = {S\,...S q } are the elements of an admissible 
partition of V(^) of maximal cardinality, and 

• E(y) has an edge (Si,Sj) if Effi) has an edge from 
some component of Si to some component of Sj. 
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We label the nodes of V(y) with the transfer function of the 
associated subsystem, which we also denote Si, and the edges 
of E(y) with the associated variable from E(^). 

Note that, like ^ , the subsystem structure y is a graph with 
vertices that represent systems and edges that represent signals, 
or system variables. For example, Figure |4(a)| illustrates the 
subsystem structure for both systems ^ and ([7]), shown in 
Figures |3(a) and 3(b) Note that the subsystem structure of 
these systems' minimally intricate realization, ([5]), is quite 
different, with a single block rather than two blocks intercon- 
nected in feedback, as shown in Figure |4(b)| This illustrates 
the necessity of auxiliary variables to adequately describe the 
complete system structure. 




(a) The subsystem structure of the linear system given by the state 
matrices (|6j with intricacy / = 8. Note that the subsystem structure of the 
equivalent, but less intricate system given by eq uation fl\ is ex actly the 
same, indicated by the shaded regions in Figures |3(a)| and |3(b)| 




(b) The subsystem partial structure 5? of the dynamically equivalent, 
minimally intricate l inear system, specified by the realization {8} cor- 
responding to Figure [3(c)] 



Fig. 4. The subsystem structure of a linear system partitions vertices of 
the complete computational structure and condenses admissible groups of 
nodes into single subsystem nodes, shown in brown; nodes shown in green 
are those that correspond directly to unaggregated vertices of the complete 
computational structure, which will always be associated with mechanisms 
that generate manifest variables. Here, the subsystem structure corres pond s to 
the in terconnection of shaded regions in Figure[3] Comparing Figures [4(a)] and 
|4(b)| we note that intricacy in a realization may be necessary to characterize 
meaningful subsystems and yield nontrivial subsystem structure. 



Lemma 2: The subsystem structure y of a system G, with 
complete computational structure ^ , is unique. 

Proof: We prove by contradiction. Suppose the subsystem 
structure y of G is not unique. Then there are at least two 
distinct subsystem structures of G, which we will label y l and 
y 2 . This implies there are two admissible partitions of Vffi), 
given by V(y l ) and V(y 2 ), such that V(y l ) ^ V(y 2 ) and 
with equal cardinality, q. Note that by definition, q must be 
the maximal cardinality of any admisible partition of Vffi). 
To obtain a contradiction, we will construct another admissible 
partition, V(y 3 ), such that \V(y 3 )\ > q. 

Consider the following partition of V that is a refinement 



of both V(y l ) and V(y 2 ): 

v(y 3 ) = {s 3 \s 3 + ®;s 3 = SiDSj.Si e v(y l ),Sj e v(y 2 )}. 

Since V(y l ) ^ V(y 2 ), then \V(y 3 )\ > q, since the cardi- 
nality of the refinement must then be greater than that of 
V(y l ) or V(y 2 ). Moreover, note that the partition V(y 3 ) is 
admissible, since every edge of ^ between vertices associated 
with distinct components of V(y 3 ) corresponds with an edge 
of either y l or y 2 , which are admissible. Thus, V(y 3 ) is 
an admissible partition of V(^) with cardinality greater than 
q, which contradicts the assumption that y l and y 2 are both 
subsystem structures of G. ■ 
The subsystem structure of a system reveals the way natural 
subsystems are interconnected, and it can be represented in 
other ways besides (but equivalent to) specifying y . For 
example, one common way to identify this kind of subsystem 
architecture is to write the system as the linear fractional 
transformation (LFT) with a block diagonal "subsystem" com- 
ponent and a static "interconnection" component (see l23ll 
for background on the LFT). For example, the system in 



Figure 4(a) can be equivalently represented by the feedback 
interconnection of a static system iV:UxW4Yx(Ux W) 
and a block-diagonal dynamic system 5:UxW^W given 
by 



N = 
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s = 



Si 






s 2 



(9) 



where 



Si: 



W 2 



Wl 

u 2 



— > W2 



(10) 



In general, the LFT associated with y will have the form 



N-- 




L 



I 

K 



Si 








S a 



(11) 



where q is the number of distinct subsystems, and L and K are 
each binary matrices of the appropriate dimension (see Figure 
[5]). Note that if additional output variables are present, besides 
the manifest variables used to interconnect subsystems, then 
the structure of N and S above extend naturally. In any event, 
however, N is static and L and K are binary matrices. 

The subsystem structure of any system is well defined 
although it may be trivial (a single internal block) if the 
system does not decompose naturally into an interconnection 
of subsystems, such as ^ in Figure |3(c) and Figure 4(b) 



Note that y always identifies the most refined subsystem 
structure possible, and for systems with many interconnected 
subsystems, coarser representations may be obtained by ag- 
gregating various subsystems together and constructing the 
resulting condensation graph. These coarser representations 
effectively absorb some interconnection variables and their 
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s q \ 



ji(u,w) 



Fig. 5. The subsystem structure of a system can always be represented by the 
lower linear fractional transformation of the static interconnection matrix N 
with a block diagonal transfer function matrix S. Note that k(u,w) represents 
a permutation of a subset of the variables in the vector inputs, u, and manifest 
auxiliary variables, w, possibly with repetition of some variables if necessary. 



associated edges into the aggregated components, suggesting 
that such representations are the subsystem structure for less 
intricate realizations of the system, where some of the manifest 
auxiliary variables are removed, or at least left hidden. The 
subsystem structure is thus a natural partial description of 
system structure when the system can be decomposed into 
the interconnection of specific subsystems. 

B. Signal Structure 

Another very natural way to partially describe the structure 
of a system is to characterize the direct causal dependence 
among each of its manifest variables; we will refer to this 
notion as the signal structure. This description of the structure 
of a system makes no attempt to cluster, or partition, the actual 
internal system states. As a result, it offers no information 
about the internal interconnection of subsystems, and signal 
structure can therefore be a very different description of system 
structure than subsystem structure. 

Given a generalized linear system Q with complete com- 
putational structure ^ , we characterize its signal structure by 
considering its minimal intricacy realization (A ,B 0J C ,D ). 
We assume without loss of generality that the outputs y are 
ordered in such a way that C can be partitioned 



Co 



C21 C22 



where C\\ G R PlXpi is invertible, with p\ equal to the 
rank of C Q \ C 12 G RPi x ( n ~Pi)' 9 C 2 \ G R^i)*^; and C 22 G 
R(p-Pi)*( n -Pi) . Note that if the outputs of the minimal intri- 
cacy realization do not result in C\\ being invertible, then it 
is possible to reorder them so the first p\ outputs correspond 
to independent rows of C ; the states can then be renumbered 
so that Cn is invertible. One can show that such reordering 
of the outputs and states of the minimal intricacy realization 



only affects the ordering of the states and outputs of the orig- 
inal system; the graphical relationship of the computational 
structure is preserved. 

The direct causal dependence among manifest variables is 
then revealed as follows. First, since C is rank p\, the rank- 
nullity theorem guarantees C Q has nullity n — p\. Let 



N 2 



where N\ G R^ x ("-^), N 2 G R^-piM^i), be a matrix of 
column vectors that form a basis for the null space of C . By 
the definition of N and the invertibility of Cn, we can write 



N-- 



-C^C 12 N 2 
N 2 



Since the columns of N form a basis, we deduce that N2 is 
invertible; thus the state transformation z = Tx given by 



C n 




C12 
WT 1 



(12) 
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is well defined. This transformation yields a system of the 
form 



(13) 



where C 2 = C 2 iC~ l l , z\ G W l , z 2 G R n ~ Pl , u G R m , y\ G W l , 
and y2 G W~ Pl . To simplify the exposition we will abuse no- 
tation and refer to the above system as (A,#,C,Z)), since there 
is little opportunity to confuse these matrices with those of the 
original system given in ([5]). In fact, the system ( [T3] ) is simply 
a change of coordinates of the minimal intricacy realization 
(A 0j B 0j C 0j D ), possibly with a reordering of the output and 
state variables. The direct causal dependence among manifest 
variables is then revealed by the dynamical structure function 
of (A,B,[ I ],Di). 

The dynamical structure function of a class of linear systems 
was defined in El and discussed in l25l <26l l27l ESI. 
(29), l30l . This representation of a linear system describes the 
direct causal dependence among a subset of state variables, 
and it will extend to characterize signal structure for the 
system in ( [T3] ). We repeat and extend the derivation here 



to demonstrate its applicability to the system ( [13] ). Taking 
Laplace transforms and assuming zero initial conditions yields 
the following relationships 



U (14) 



where Z(s) denotes the Laplace transform of z(t), etc. Solving 
for Z 2 in the second equation and substituting into the first then 
yields 

sZi = W(s)Z!+V(s)U (15) 



sZ\ 
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A 12 " 




' Zi " 
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where W(s) = [A n +A l2 {sI- A 22 )~ 1 A 2 i] and V(s) = 
[Bi +A u (sI-A 22 )~ l B 2 ]. Let D(s) be the matrix of the di- 
agonal entries of W(s), yielding 



Z 1 = Q(s)Z 1 +P(s)U 



(16) 



where Q(s) = (si - Dh))' 1 (W(s) - D(s)) and P(s) = (si - 
D(s))~ l V(s). From |l3} we note that Z x = Y\ -DiU, which, 
substituting into ( [16] ), then yields: 



Yi 

Y 2 



Q{s) 
c 2 



P(s)- 



(I-Q(s))D l 
D 2 



U (17) 



We refer to the matrices 

[ Q(s) T Cl f [ (P(s) + (I-Q(s)) Dl f Dl ] T 

as Q and P. respectively. The matrices (Q(s),P(s)) are called 
the dynamical structure function of the system ( [T3] ), and they 
characterize the dependency graph among manifest variables 
as indicated in Equation §Tl\ . We note a few characteristics 
of (Q(s),P(s)) that give them the interpretation of system 
structure, namely: 

• Q(s) is a square matrix of strictly proper real rational 
functions of the Laplace variable, s, with zeros on the 
diagonal. Thus, if each entry of y\ were the node of a 
graph, Qij(s) would represent the weight of a directed 
edge from node j to node i\ the fact Qij(s) is proper 
preserves the meaning of the directed edge as a causal 
dependency of yt on yj. 

• Similarly, the entries of the matrix [P(s) + (/ — Q(s))D{\ 
are proper and thus carry the interpretation of causal 
weights characterizing the dependency of entries of y\ 
on the m inputs, u. Note that when D\ = 0, this matrix 
reduces to P{s), which has strictly proper entries. 

This leads naturally to the definition of signal structure. 

Definition 6: The signal structure of a system G, with 
realization §5§ and equivalent realization ( [T3] ), and with dy- 
namical structure function (Q(s),P(s)) characterized by (16), 
is a directed graph W, with a vertex set V{W) and edge set 
E(W) given by: 

. V(W) {wi,...,M m ,yii,...,yi Pl ,y2i,...,y2p 2 }, each repre- 
senting a manifest signal of the system, and 

• E(W) has an edge from u\ to yij, U{ to y2j, yu to y\j or 
yu to y2j if the associated entry in [P(s) + (I — Q(s))D\], 
D2, Q(s), or C21 (as given in Equations ( [l6| ) and is 
nonzero, respectively. 

We label the nodes of V(W) with the name of the associated 
variable, and the edges of E(W) with the associated transfer 
function entry from Equation §FJ\ . 

Signal structure is fundamentally a different type of graph 
than either the computational or subsystem structure of a 
system because, unlike these other graphs, vertices of a 
system's signal structure represent signals rather than systems. 
Likewise, the edges of W represent systems instead of signals, 
as opposed to ^ or y. We highlight these differences by 
using circular nodes in W, in contrast to the square nodes 
in ^ or y. The next example illustrates a system without 



notable subsystem structure and no apparent structural motif 
in its complete computational structure; nevertheless, it reveals 
a simple and elegant ring structure in its signal structure. 

Example 1: Ring Signal Structure. Systems with no ap- 
parent structure in any other sense can nevertheless possess 
a very particular signal structure. Consider the minimally 
intricate linear system, specified by the state- space realization 
(A ,B 0J C 0J D ), where 
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(18) 




Fig. 6. The complete computational structure ^, of the system 
(A 0l B 0l C 0l D ) given by fT8) . Here, edge labels, u and x, and self loops 
on each node ft have been omitted to avoid the resulting visual complexity. 
Edges associated with variables x, which are not manifest, are entirely 
contained within the shaded region (whic h also corresponds to the strong 
partial condensation shown in Figure [7(a)). 



We compute the signal structure by employing a change 
of coordinates on the state variables to find an equivalent 
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(a) T he subsystem structure, 5^ , of the system shown in Figures [6] and 
|7(b)| the system has no interconnection structure between subsystems 
because the system is composed of only a single subsystem; it does not 
meaningfully decompose into smaller subsystems. 




(b) The signal structure, W , of the system shown in Figures [6] and |7(a)| 
Note that, in contrast with ^ and 5?, vertices of W represent manifest 
signals (characterized by round nodes), while edges represent systems. 

Fig. 7. Distinct notions of partial structure for the system (A ,B ,C ,D ) 
given by Equation fT8) . Observe that while the system is unstructured in 
the strong sense, it is actually quite structured in the weak sense. Moreover, 
although the subsystem structure is visible in the complete computational 
structure (Figure [6j as a natural condensation (note the shaded region), the 
signal structure is not readily apparent. 



realization of the form ( [T3] ). The transformation 
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(19) 



results in the following realization 



A = TA T~ l = 
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B = TBq 



' 2 





" 





3 











6 






























C = C T- 1 =[I 3 



D = D = [0}. 



(20) 

The dynamical structure function of the system, (Q,P), then 
becomes 
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(21) 



which yields the signal structure, W , as shown in Figure 7(b) 
Notice that although the complete computational structure 
and subsystem structure do not characterize any meaningful 
interconnection patterns, the system is nevertheless structured 
and organized in a very concrete sense. In particular, the 
outputs yi, y2, and form a cyclic dependency, and each 
causally depends on a single input u^i= 1,2,3,, respectively. 

C. Sparsity Structure of the Transfer Function Matrix 

The weakest notion of structure exhibited by a system is the 
pattern of zeros portrayed in its transfer function matrix, where 
"zero" refers to the value of the particular transfer function 
element, not a transmission zero of the system. Like signal 
structure, this type of structure is particularly meaningful 
for multiple-input multiple-output systems, and, like signal 
structure, the corresponding graphical representation reflects 
the dependance of system output variables on system input 
variables. Thus, nodes of the graph will be signals, represented 
by circular nodes, and the edges of the graph will represent 
systems, labeled with the corresponding transfer function 
element; a zero element thus corresponds to the absence of 
an edge between the associated system input and output. 
Formally, we have the following definition. 

Definition 7: The sparsity structure of a system G is a 
directed graph 3f, with a vertex set V(3F) and edge set E(3F) 
given by: 

• V(3f) = {u\, ...,w m ,yi, ...,y p }, each representing a mani- 
fest signal of the system, and 
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• E(3f) has an edge from U[ to yj if Gji is nonzero. 
We label the nodes of V(3f) with the name of the associated 
variable, and the edges of E(3f) with the associated element 
from the transfer function G(s). 

Unlike signal structure, note that the sparsity structure of the 
transfer function matrix describes the closed-loop dependency 
of an output variable on a particular input variable, not its 
direct dependence. As a result, the graph is necessarily bipar- 
tite, and all edges will begin at an input node and terminate at 
an output node; no edges will illustrate dependencies between 
output variables. For example, the sparsity structure for the 
system in Example [T] is shown in Figure [8j with transfer 
function G(s) = 



-18(P+12s 2 +47s+60) 
djs) 



■2 (P + 1 Os 2 +29.5+20) 3 (s 5 + 1 6s 4 +97s 3 +274s 2 +352s + 160) 



-20(^+1) 
d(s) 



where d(s) = s { 
450, m(s) = 2(s 5 + 
n 2 {s) = 6(s 5 + 15/ 



30(^+7^ + 145+8) 



d(s) 



19s 5 + 145/ + 565/ + 
-17/ + lll/ + 343/^ 
85s 3 + 225s 2 + 274s 



1174s 2 + 1216s + 
488s + 240), and 
+ 120). Although 




Fig. 8. The sparsity structure for the system in Example [T] Note that vertices 
of sparsity structure are manifest signals, distinguished in this work by circular 
nodes similar to those of signal structure. Nevertheless, this system has a fully 
connected (and t hus un structured) sparsity structure, while its signal structure 
(shown in Figure 17(b)) exhibits a definite ring structure. 



the direct dependence, given by the signal structure, is cyclic 
(Figure |7(b)| ), there is a path from every input to every output 
that does not cancel. Thus, the sparsity structure is fully 
connected, corresponding to the full transfer function matrix 



in Equation (|22). 

It is important to understand that the sparsity structure does 
not necessarily describe the flow of information between inputs 
and outputs. The presence of a zero in the (/,7') th location 
simply indicates that the input-output response of the system 
results in the z th output having no dependence on the / h input. 
Such an effect, however, could be the result of certain internal 



cancellations and does not suggest, for example, that there is 
no path in the complete computational structure from the / h 
input to the / th output. Thus, for example, a diagonal transfer 
function matrix does not imply the system is decoupled. 

The next example demonstrates that a fully coupled system 
may, nevertheless, have a diagonal transfer function, even 
when the system is minimal in both intricacy and order. 
That is, the internal cancellations necessary to generate the 
diagonal sparsity structure in the transfer function while being 
fully coupled do not result in a loss of controllability or 
observability. Thus, the sparsity structure only describes the 
input-output dependencies of the system and does not imply 
anything about the internal information flow or communication 
structure. This fact is especially important in the context of 
decentralized control, where the focus is often on shaping the 
sparsity of a controller's transfer function given a particular 
sparsity in the transfer function of the system to be controlled. 

Example 2: Diagonal Transfer Function ^ Decoupled. 
Consider a system, G, with the following minimal intricacy 
realization, (A Q ,B ,C ,D )\ 
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(23) 

It is easy to see from (A ,B ,C ,D ) that this system has a 
fully connected complete computational structure. Moreover, 
one can easily check that the realization is controllable and ob- 
servable, and thus of minimal order. Nevertheless, its transfer 
function is diagonal, given by 



G(s) = 



6 







-6 
s+6 



(24) 



IV. Relationships Among Representations of 
Structure 

In this section, we explore the relationships between the four 
representations of structure defined above. What we will find 
is that some representations of structure are more informative 
than others. Next, we will discuss a specific class of systems 
in which the four representations of structure can be ranked 
by information content (with one representation encapsulating 
all the information contained in another representation of 
structure). Outside this class of systems, however, we will 
demonstrate that signal structure and subsystem structure have 
fundamental differences in addition to those arising from the 
graphical conventions of circular versus square nodes, etc. 
Signal and subsystem structure provide alternative ways of 
discussing a system's structure without requiring the full detail 
of a state-space realization or the abstraction imposed by 
a transfer function. Understanding the relationships between 
these representations then enables the study of new kinds of 
research problems that deal with the realization, reconstruc- 
tion, and approximation of system structure (where structure 
can refer to the four representations defined so far or other 
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representations of structure not mentioned in this work). The 
final section gives a discussion of such future research. 

Different representations of structure contain different kinds 
of structural information about the system. For example, 
the complete computational structure details the structural 
dependencies among fundamental units of computation. Using 
complete computational structure to model system structure 
requires knowledge of the parameters associated with each 
unit of computation. Partial representations of structure such 
as signal and subsystem structure do not require knowledge of 
such details in their description. Specifically, subsystem struc- 
ture essentially aggregates units of computation to form sub- 
systems and models the closed-loop transfer function of each 
subsystem. Signal structure models the SISO transfer functions 
describing direct causal dependencies between outputs and 
inputs of some of the fundamental units of computation that 
happen to be manifest. Sparsity structure models the closed- 
loop dependencies of system outputs on inputs. Thus, complete 
computational structure appears to be the most demanding or 
information-rich description of system structure. This intuition 
is made precise with the following result: 

Theorem 1: Suppose a complete computational structure 
has minimal intricacy realization (A ,B ,C ,D ) with 



C = 



C21 C22 



and Cn invertible. Then the complete computational structure 
specifies a unique subsystem, signal, and sparsity structure. 

Proof: Let ^ be a computational structure with minimal 
intricacy realization (A 01 B 01 C 01 D ) with 



Co 



C n 
C21 



Cn 
C22 



C\\ invertible. By Lemma [2] the subsystem structure y is 
unique. Since C\\ is invertible, we see that equations ( p"5) 
and ^Tf\ imply that the minimal intricacy realization uniquely 
specifies the dynamical structure function of the system. By 
definition, the signal structure is unique. Finally, write the 
generalized state- space realization of as 



(A,B,C,D) : 



' A A~ 




' B ' 


A A 


1 


B 



,[C C ],Dj 



The uniqueness of the sparsity structure follows from its 
one-to-one correspondence with the transfer function G(s) = 
C (si — A )~ l B +D which can also be expressed as 

(C + C(I-A)- l A)(sI-A-A(I-A)- l A)- l (B + B(I-A)- l A). 



It is well known that a transfer function G(s) can be realized 
using an infinite number of state- space realizations. Without 
additional assumptions, e.g. full state feedback, it is impossible 
to uniquely associate a single state- space realization with a 
given transfer function. On the other hand, a state space 
realization specifies a unique transfer function. In this sense, a 
transfer function contains less information than the state space 
realization. 



Similarly, subsystem, signal, and sparsity structure can be 
realized using multiple complete computational structures. 
Without additional assumptions, it is impossible to associate 
a unique complete computational structure with a given sub- 
system, signal, or sparsity structure. Theorem [T] shows that a 
complete computational structure specifies a unique subsys- 
tem, signal, and sparsity structure. In this sense, a complete 
computational structure is a more informative description of 
system structure than subsystem, signal and sparsity structure. 
The next result has a similar flavor and follows directly from 
the one-to-one correspondence of a system's transfer function 
with its sparsity structure. 

Theorem 2: Every subsystem structure or signal structure 
specifies a unique sparsity structure. 

Proof: Consider the LFT representation ^(N^S) of a 
subsystem structure write 



N-- 



' 


I 


L 


K 



as in equation ( pT) . The linear fractional transform gives the 
input-output map, i.e. the transfer function. Thus, G(s) = (I — 
SK)~ l SL. 

Similarly, using the dynamical structure representation of 
the signal structure W given in equation (17), we can solve 
for the transfer function 



G(s) 





' Q(s) ' 
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c 2 





P(s)- 



(I-Q(s))D l 
D 2 



The result follows from the definition of sparsity structure. ■ 
The relationship between subsystem structure and signal 
structure is not so straightforward. Nevertheless, subsystem 
structure does specify a unique signal structure for a class of 
systems, namely systems with subsystem structure composed 
of single output (SO) subsystems and where every manifest 
variable is involved in subsystem interconnection. For this 
class of systems, subsystem structure is a richer description 
of system structure than signal structure. 

A. Single Output Subsystem Structure and Signal Structure 

Theorem 3: Let 5? be a SO subsystem structure with LFT 
representation &(N,S). Suppose 



N-- 



where [L Kj has full column rank. Then 5? uniquely spec- 
ifies the signal structure of the system. 

Proof: The dynamics of N and S satisfy 
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L 


K 



Y = [0]U + [I\Y 
71 = LU + KY 

Y = S7T 

Combining the second and third equation, we get 
Y = Sn = S[K L] Y 



(25) 
(26) 
(27) 
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Since is a SO subsystem structure, the entries of S describe 
direct causal dependencies among manifest variables involved 
in interconnection. Since [L K] has full column rank and 
is a binary matrix, this means that each manifest variable is 
used at least once in interconnection. Thus, S describes the 
direct causal dependencies between all manifest variables of 
the system and specifies the signal structure of the system. ■ 
Notice that for the class of systems described above, the four 
representations of structure can be ordered in terms of infor- 
mation content. Theorem [T] shows that the complete computa- 
tional structure uniquely specifies all the other representations 
of structure and thus is the most informative of the four. By 
Theorem [3] and Theorem [2] respectively, subsystem structure 
uniquely specifies the signal structure and sparsity structure of 
the system and thus is the second most informative. Similarly, 
signal structure is the third most informative and sparsity 
structure is the least informative of the four representations 
of structure. 

We note that the converse of Theorem is also true, namely 
if the subsystem structure of a system specifies a unique 
signal structure then the subsystem structure is a SO subsystem 
structure where every manifest variable is an interconnection 
variable. The proof is simple and follows from the result 
of the next subsection. We also provide several examples 
that show how a multiple output subsystem structure can be 
consistent with multiple signal structures - these all will serve 
to illustrate the general relationship between subsystem and 
signal structure outside of the class of systems mentioned 
above. 

B. The Relationship Between Subsystem and Signal Structure 

Subsystem structure and signal structure are fundamentally 
different descriptions of system structure. In general, subsys- 
tem structure does not encapsulate the information contained 
in signal structure. Signal structure describes direct causal 
dependencies between manifest variables of the system. Sub- 
system structure describes closed loop dependencies between 
manifest variables involved in the interconnection of subsys- 
tems. Both representations reveal different perspectives of a 
system's structure. The next result makes this relationship 
between subsystem and signal structure precise. 

Theorem 4: Given a system G, let &(N,S) be the LFT 
representation of a subsystem structure y. In addition, let 
the signal structure of the system G be denoted as in equation 



Proof: Examining relation ( 28 ), observe that the ij th entry 



(17). Let Y(Si) denote the outputs associated with subsystem 
Si. Define 



Qij(s) y u yj e Y(S k ),S k a subsystem in 
otherwise, 



and Q ext = Q(s) — Qi n t(s). Then the signal structure and 
subsystem structure are related in the following way: 



of the left hand side describes the closed loop causal depen- 
dency from the / h entry of [ U T Y T ] to Y{. By closed 
loop, we mean that they do not describe the internal dynamics 
of each subsystem, e.g. the direct causal dependencies among 
outputs of a single subsystem. Thus, these closed loop causal 
dependencies are obtained by solving out the intermediate 
direct causal relationships, i.e. the entries in Qj nt . Notice that 



the right hand side of ( 28 ) also describes the closed loop map 
from [U T F r ] to 7, and in particular the ij th entry of 

(l-Qint)- l [ P | Qext } 

describes the closed loop causal dependency from the jth entry 
of [ U Y f to Y t . M 

As a special case, notice that for SO subsystem structures, 
Qi nt becomes the zero matrix and that for subsystem structures 
with a single subsystem, S becomes the system transfer 
function, L becomes the identity matrix, Q[ nt = Q, and Q ext 
and K are both zero matrices. The primary import of this result 
is that a single subsystem structure can be consistent with two 
or more signal structures and that a single signal structure can 
be consistent with two or more subsystem structures. Consider 
the following examples: 

Example 3: A Signal Structure consistent with two Subsys- 
tem Structures 

In this example, we will show how a signal structure can 
be consistent with two subsystem structures. To do this we 
construct two different generalized state- space realizations that 
yield the same minimal intricacy realization but different 
admissible partitions (see Definition [4]). The result is two 
different subsystem structures that are associated with the same 
signal structure. First, we consider the complete computational 
structure ^\ with generalized state-space realization 
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S[L\K ]=(I-Q i „t)- 1 [P\Q, 



(28) 



and D\ = Figure 9(a) shows the computational structure 

Si. 
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generalized state-space realization 



(A 2 ,B 2 ,C 2 ,D 2 ): 
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, [ C 2 C 2 ],D 2 ). 



The matrix entries of this generalized state-space realization 
are given as follows: 
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and D2=D\. Figure 9(b) shows the computational structure 
^2- The difference between these two computational structures 
is evident more in the subsystem structure representation of 
(a) The complete computational structure ^1 with generalized state-space the system - note how replacing A\ with A 2 , essentially 
realization (A^B^Ci.Di). We have omitted the self-loops on each of the / externalizes internal dynamics. The result is that ^ 2 admits a 

subsystem structure 5^2 which divides one of the subsystems 
of S?\ into two subsystems. This is more apparent in the LFT 
u > representations of and ^ 2 ; the LFT representation of 

is given by ^{N\,S\) = 



vertices for the sake of visual clarity. 
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(b) The complete computational structure ^2 with generalized state-space 
realization (A2,B2, C2,T>2)- We have omitted the self-loops on each of the / 
vertices for the sake of visual clarity. 

Fig. 9. The complete computational structures of two systems that differ only 
by a slight rearrangement of their state- space dynamics. The rearrangement 
results in two different subsystem structure representations. Nonetheless, the 
resulting minimal intricacy realization for both systems is the same, implying 
that both systems have an identical signal structure. 



with Sn(s),Si 2 (s),Si3(s) given by 
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Next consider the complete computational structure ^ 2 with respectively. 
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The LFT representation of y 2 (s) is represented as the LFT 
&{N 2 ,S 2 ) = where 



Reconsider Sf 2 . The LFT is given by ^(N 2l S 2 ) where 
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and S2 (s) , S21 (s) , S22 ( s ) respectively given as 
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However, if we consider the minimal intricacy realiza- 
tions of ^1,^2 we get the same state-space realization 
(Ao,B ,Co,D ) with 
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The signal structure of the system is thus specified by the 
dynamical structure function (Q,P)(s), with 





13+5 

5 2 + 175+64 
2 
5-J-6 

5+6 



12+5 

5 2 + 145+39 



1 

s t 6 

5+6 



2(5+10) 

5 2 +145+39 
2(5+10) 

5 2 + 175+64 



2 
5+6 



5+10 " 

5 2 +145+39 

5+10 

5 2 + 175+64 
5+6 





P(s) 



11+5 



5 2 +145+39 

13+5 

5 2 + 175+64 
5+6 
5+6 



Example 4: A Subsystem Structure consistent with two Sig- 
nal Structures 

Now we consider a subsystem structure with multiple signal 
structures. Recalling the discussion above, subsystem structure 
describes the closed loop causal dependencies between man- 
ifest interconnection variables and signal structure specifies 
direct causal dependencies between manifest variables. When 
it is impossible to determine these direct causal dependencies 
by inspection from the closed loop causal dependencies in a 
subsystem structure representation, then there can be multiple 
signal structures that are consistent with the subsystem struc- 
ture. 
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If we consider the relation 



S 2 [K L ]={I-Q int )- 1 [ Qext P 



we can take (Q,P)(s) to equal 





13+5 



12+5 



5 Z + 



5 2 + 175+64 



2 
5+6 

5+6 



145+39 



1 

5+6 



2(5+10) 

5 2 +145+39 
2(5+10) 

5 2 + 175+64 



2 
5+6 



5+10 ' 

5 2 +145+39 

5+10 

5 2 + 175+64 
5+6 





11+5 



with 



Qint 





13+5 



5 2 + 175+64 








5 2 +145+39 

13+5 

5 2 + 175+64 
1 

5-J-6 

5+6 



12+5 

5 2 + 145+39 











2 

5+6 







1 

5+6 



15 



and Q ext = Q\ - Q inU or Q 2 (s) 
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previous section, we demonstrated that partial structure repre- 
sentations of a system are generally more informative than its 
transfer function but less informative than its state realization. 
Thus, two classes of representation questions emerge: recon- 
struction problems and structure realization problems (Figure 
ITOl. 



^+19s+86 
P+21s 2 +i30s+234 

(13+s)Q+5) 
P+21s 2 + i30s+234 

7+s 
s 2 +12s+34 

s+S 
s 2 + 125+34 

and taking Qi nt = [0] and Q ext = g2- It is routine to show 
that with these definitions, both (Qi,P\)(s) and (02? ^2) (s) 
are consistent with £2- Thus a single subsystem structure 
can be consistent with two signal structures. It is important 
to note that one of our signal structures exhibited direct 
causal dependencies corresponding exactly with the closed 
loop dependencies described by subsystem structure. We note 
that this correspondence sometimes occurs (as in the case of 
Theorem [3} but generally does not hold. 

V. Impact on Systems Theory 

The introduction of partial structure representations suggests 
new problems in systems theory. These problems explore the 
relationships between different representations of the same 
system, thereby characterizing properties of the different repre- 
sentations. For example, classical realization theory considers 
the situation where a system is specified by a given transfer 
function, and it explores how to construct a consistent state 
space description. Many important ideas emerge from the 
analysis: 

1) State realizations are generally more informative than 
a transfer function representation of a system, as there 
are typically many state realizations consistent with the 
same transfer function, 

2) Order of the state realization is a sensible measure of 
complexity of the state representation, and there is a 
well-defined minimal order of any realization consistent 
with a given transfer function; this minimal order is 
equal to the Smith-McMillian degree of the transfer 
function, 

3) Ideas of controllability and observability of a state 
realization characterize important properties of the real- 
ization, and any minimal realization is both controllable 
and observable. 

In a similar way, introducing partial structure representations 
impacts a variety of concepts in systems theory, including 
realization, minimality, and model reduction. 

A. Realization 

The definition of partial structure representations enrich 
the kinds of realization questions one may consider. In the 




Fig. 10. Partial structure representations introduce new classes of realiza- 
tion problems: reconstruction and structure realization. These problems are 
distinct from identification, and each depends on the type of partial structure 
representation considered. 

Reconstruction problems consider the construction of a par- 
tial structure representation of a system given its transfer func- 
tion. Because partial structure representations are generally 
more informative than a transfer function, these problems are 
ill-posed-like the classical realization problem. Nevertheless, 
one may consider algorithms for generating canonical repre- 
sentations, or one may characterize the additional information 
about a system-beyond knowledge of its transfer function- 
that one would require in order to specify one of its partial 
structure representations. In particular, we may consider two 
types of reconstruction problems: 

1) Signal Structure Reconstruction: Given a transfer 
function G(s) with its associated sparsity structure 3f, 
find a signal structure, W, with dynamical structure 
function (Q,P) as in Equation (17) such that G = 

{i-Q)~ l P, 

2) Subsystem Structure Reconstruction: Given a transfer 
function G{s) with its associated sparsity structure 3f, 
find a subsystem structure, y, with structured LFT 
(N,S) as in Equation (TTTb such that G = (I-SK)~ l SL. 



Signal structure reconstruction is also called network recon- 
struction, particularly in systems biology where it plays a 
central role. There, the objective is to measure fluctuations 
of various proteins, or other chemical species, in response to 
particular perturbations of a biochemical system, and then infer 
causal dependencies among these species l3TlL l32l . l29lL (24), 

E2, El. 

Structure realization problems then consider the construc- 
tion of a state space model, possibly generalized to include 
auxiliary variables as necessary, consistent with a given partial 
structure representation of a system. Like the classical realiza- 
tion problem or reconstruction problems, these problems are 
also ill-posed since there are typically many state realizations 
of a given partial structure representation of a system. Also, 
like reconstruction problems, these realization problems can 
be categorized in two distinct classes, depending on the type 
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of partial structure representation that is given: 

3) Signal Structure Realization: Given a system G with 
signal structure W and associated dynamical structure 
function (Q,P), find a state space model (A,#,C,Z)) 
consistent with (Q,P), i.e. such that Equations ( T4p7 ) 
hold, 

4) Subsystem Structure Realization: Given a system G 
with subsystem structure y and associated structured 
(N,S) (recorded in the LFT representation ^(N,S)) 9 
find a generalized state space model of the form of 
Equation ^ consistent with (N,S). 

Signal structure realization may sometimes be called network 
realization, consistent with the nomenclature for signal struc- 
ture reconstruction. 

Note that all the reconstruction and structure realization 
problems here are distinct from identification problems, just 
as classical realization is different from identification. For the 
systems considered here, identification refers to the use of 
input-output data (and no other information about a system) 
to choose a representation that best describes the data in some 
appropriate sense. Because input-output data only character- 
izes the input-output map of a system, identification can at 
best characterize the system's transfer function; no information 
about structure, beyond the sparsity structure, is available 
in such data. In spite of this distinction, however, it is not 
uncommon for reconstruction problems to be called structure 
identification problems. Nevertheless, one may expose such 
problems as the concatenation of an identification and a 
reconstruction problem and precisely characterize the extra 
information needed to identify such structure by carefully 
analyzing the relevant reconstruction problem, independent of 
the particular identification technique l24l . |3H . 



B. Minimality 

Just as partial structure representations enrich the classical 
realization problem, they also impact the way we think about 
minimality. Certainly the idea of a minimal complexity repre- 
sentation is relevant for each of the four problems listed above, 
but clearly the relevant notion of complexity may be different 
depending on the representation. We consider each situation 
as follows: 

1) Minimal Signal Structure Reconstruction: In this 
situation one needs to consider how to measure the 
complexity of a system's signal structure, W, or its 
associated dynamical structure function, (Q,P). Some 
choices one may consider could be the number of edges 
in W, the maximal order of any element in (Q,P), or 
the maximal order of any path from any input U{ to 
any output yj. The problem would then be to find a 
minimal complexity signal structure consistent with a 
given transfer function. 

2) Minimal Subsystem Structure Reconstruction: In this 
situation one needs to consider how to measure the 
complexity of a system's subsystem structure, y, or 
its associated structured LFT, (N,S). One notion could 



be to measure complexity by the number of distinct 
subsystems; the problem would then be to find the 
minimal complexity subsystem structure representation 
consistent with a given transfer function. Another notion 
could be the number of non-zero entries in the S matrix, 
where (N,S) denote the the LFT associated with the 
subsystem structure. Using this measure, a single sub- 
system block with no zero entries would be considered a 
more complex representation than a subsystem structure 
with a large number of distinct, albeit interconnected, 
subsystems. 

3) Minimal Signal Structure Realization: In this situation 
one needs to consider how to measure the complexity 
of a system's zero-intricacy state realization, from which 
signal structure is derived. The obvious choice would be 
to use the order of the realization as a natural measure 
of complexity, and the problem would then be to find 
the minimal order state realization 1291 , l35l consistent 
with a given signal structure, W, or, equivalently, with 
its associated dynamical structure function, (Q,P). Note 
that this minimal order is guaranteed to be finite (for 
the systems considered here) and can easily be shown 
to be greater or equal to the Smith-McMillian degree 
of the transfer function specified by the signal structure; 
we call this number the structural degree of the signal 
structure l25l . 

4) Minimal Subsystem Structure Realization: In this 
situation one needs to consider how to measure the com- 
plexity of a generalized state realization in the presence 
of auxiliary variables. Both the order and the intricacy of 
the realization offer some perspective of its complexity, 
but one needs to consider how they each contribute to the 
overall complexity of the realization. The problem would 
then be to find a minimal complexity generalized state 
realization consistent with a given subsystem structure. 

These various problems demand new ideas for thinking 
about the complexity of a system's representation, especially 
that of a partial structure representation. These new ideas about 
complexity, in turn, introduce opportunities for characterizing 
minimality of a representation in terms that add insight to our 
understanding of the relationship between a system's behavior 
and its structure, much as controllability and observability 
characterize classical notions of minimality in a system's state 
realization. Besides suggesting the need for a characterization 
of minimality, however, these ideas also impact notions of 
approximation and how we think about model reduction. 

C. Model Reduction 

Each of the reconstruction and structure realization prob- 
lems described above have associated with them not only 
a minimal-representation version of the problem, but also 
an approximate-representation version of the problem. The 
minimal-representation versions of these problems, as de- 
scribed above, seek to construct a representation of minimal 
complexity in the targeted class that is nevertheless consistent 
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with the system description provided. Similarly, approximate- 
representation versions of these problems seek to construct a 
representation in the targeted class that has a lower complexity 
than the minimal complexity necessary to deliver consistency 
with the system description provided. As a result, consistency 
with the given system description can not be achieved, so 
measures of approximation become necessary to sensibly 
discuss a "best" representation of the specified complexity. 

For example, associated with the classical realization prob- 
lem is the standard model reduction problem. In this situation, 
a transfer function is specified, and one would like to construct 
a state realization with a complexity that is lower than that 
which is necessary (for such a realization to be consistent 
with the given transfer function) that nevertheless "best" 
approximates it. Note that the appropriate notion of complexity 
depends on the target representation class; here, the target 
representation class is the set of state realizations, so the 
appropriate notion of complexity is model order. Likewise, 
note that the appropriate notion of approximation depends on 
the type of system representation that is initially provided; 
here, a transfer function is provided, so an appropriate measure 
of approximation could be an induced norm, such as Hoc. 
Thus, one could measure the quality of an approximation by 
measuring the induced norm of the error between the given 
transfer function and that specified by the approximate state 
realization. Note that since the Hoo model reduction problem 
remains open, many alternative measures and approaches have 
been suggested l36lL (37), |23|. In any event, because the 
specified system description is a transfer function, the resulting 
measure of approximation is typically one that either directly 
or indirectly measures the difference in input-output dynamic 
behavior between the approximate model and the given system 
description; the focus is on dynamics, not system structure, 
when considering notions of approximation in the standard 
model reduction problem. 

Similarly, there is an appropriate reduction problem asso- 
ciated with each of the minimal reconstruction and minimal 
structure realization problems described above. Like standard 
model reduction, the appropriate notion of complexity is 
characterized by the class of target representations, while the 
appropriate measure of approximation depends on the system 
representation that is initially provided. To make these ideas 
more concrete, we discuss each of the problems individually: 
1) Approximate Signal Structure Reconstruction: In 
this situation one would like to find a signal structure 
representation with lower complexity e.g. fewer number 
of edges, etc. than the minimal level of complexity 
necessary to specify a given transfer function. When 
using the number of edges as a complexity measure, 
this problem may be interpreted as trying to restrict 
the number of communication links between individual 
computation nodes in a distributed system while approx- 
imating some desired global dynamic. The appropriate 
measure of approximation, then, is any measure that 
sensibly compares the desired transfer function from that 
specified by the reduced signal structure, such as H^. 



2) Approximate Subsystem Structure Reconstruction: 

In this situation one would like to find a subsystem 
structure representation with lower complexity than the 
minimal level of complexity necessary to specify a 
given transfer function. If one considers the number 
of subsystems as the measure of complexity, then this 
problem is trivial since any transfer function is consistent 
with a subsystem structure with a single subsystem. If 
one measures complexity by the number of non-zero 
entries in the S matrix, where (N, S) denote the the LFT 
associated with the subsystem structure, then it appears 
likely that one could often formulate a meaningful 
approximation problem. 

Unlike these approximate reconstruction problems, approx- 
imate realization problems may have dual relevant measures 
of approximation, since having an initial partial structure 
representation of a system also always specifies its transfer 
function. Measuring the similarity between transfer functions 
determines the degree to which a lower order system approx- 
imates the dynamics of a given system, while measuring the 
similarity between partial structure representations determines 
the degree to which a lower order system approximates the 
structure of a given system. 

3) Approximate Signal Structure Realization: In this 
situation one would like to find a state realization with 
a model complexity that is lower than the minimal 
complexity necessary to specify a given signal structure. 
Typically the complexity of a generalized state realiza- 
tion would be measured by both the order and intricacy 
of the realization. Since signal structure only depends 
on the zero intricacy realization of a system, however, 
a minimal complexity realization will always have zero 
intricacy; thus model order is the only relevant notion 
of complexity. Moreover, since the structural degree of 
a particular signal structure may be strictly greater than 
the Smith-McMillian degree of the transfer function it 
specifies, a few distinct kinds of approximation problems 
emerge: structural approximation and dual approxima- 
tion (Figure [TT]). 

a) Structural Approximation: When the order of the 
approximation is less than the structural degree 
of the given signal structure but greater than the 
Smith-McMillian degree of the associated transfer 
function, the resulting approximation can specify 
the given transfer function exactly, even though its 
signal structure only approximates that of the given 
system. Note that the sense in which similarity in 
signal structure should be measured is an area of 
on-going research. 

b) Dual Approximation: When the order of the 
approximation is less than the Smith-McMillian 
degree of the transfer function specified by the 
given signal structure, then it will represent neither 
the structure nor the dynamics of the given system 
exactly. 
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Fig. 11. Approximate signal structure realization leads to two distinct 
types of reduction problems. Structural approximation exactly realizes the 
dynamics of a given signal structure while only approximating its structure; 
dual approximation captures neither the dynamics nor the structure of a given 
signal structure exactly. 



4) Approximate Subsystem Structure Realization: In 

this situation one would like to find a generalized state 
realization with a model complexity that is lower than 
the minimal complexity necessary to specify a given 
subsystem structure. Here, complexity of a generalized 
state realization is measured both in terms of intricacy 
and order since intricacy of a realization directly impacts 
the number of admissible subsystem blocks (see Figure 
[3} while order impacts the ability of the realization 
to approximate the transfer function specified by the 
given subsystem structure. As a result, three distinct ap- 
proximation problems emerge to complement subsystem 
structure realization: Structure-Preserving Model Reduc- 
tion, Subsystem Structure Approximation, Subsystem 



Dual Approximation (Figure 12). 



a) 



Structure-Preserving Model Reduction: When 
the intricacy of an approximation is high enough, 
the subsystem structure of a system can be pre- 
served while its dynamic behavior is approximated 
by lower-order systems. A naive approach to such 
reduction would be to reduce the order of various 
subsystems. However, even when each subsystem 
is well approximated, the dynamic behavior of 
the overall interconnection may be very different 
from the original system. As a result, methods 
have been developed in this area for approximating 



b) 



c) 



the dynamics of the closed-loop, interconnected 
system while preserving its subsystem structure 
EH, 1591, BO). 

Subsystem Structure Approximation: When the 
order of an approximation is high enough, the dy- 
namic behavior of a system can be preserved while 
is subsystem structure is approximated by lower- 
intricacy realizations. The sense in which similarity 
of subsystem structure should be measured remains 
an open topic for research. 

Subsystem Dual Approximation: When both the 
order and the intricacy of an approximation are 
lower than the minimal values necessary to realize 
a given subsystem structure and the transfer func- 
tion it specifies, then the objective of the reduction 
problem is to find the realization of the specified 
complexity that best approximates the structure and 
dynamics of the given system. 




Fig. 12. Approximate subsystem structure realization leads to three dis- 
tinct types of reduction problems: 1) Structure-preserving model reduction 
preserves the subsystem structure of a given system while approximating 
its dynamic behavior, 2) Subsystem structure approximation preserves the 
dynamic behavior but approximates the subsystem structure, and 3) Subsystem 
dual approximation captures neither the structure nor the dynamic behavior 
of a system described by a particular subsystem structure. 

The introduction of partial structure representations suggests 
a number of new problems in systems theory. These problems 
include new classes of realization problems, called reconstruc- 
tion and structural realization problems, as well as a number 
of new reduction problems. Each of these problems differ 
depending on the partial structure representation one considers, 
and a number of research issues remain to properly formulate 
most of them. The overview offered here is merely meant to 
give a perspective of the landscape of problems that emerges 
with the introduction of partial structure representations. 

VI. Conclusion 

This paper introduced the idea of a system's complete 
computational structure as a baseline for comparing simplified 
representations. Although closely aligned with a system's state 
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space realization, we demonstrated the need for auxiliary 
variables to encode information about a system's admissible 
subsystem structure. This results in a "generalized" state de- 
scription that is a differential algebraic system with differentia- 
tion index zero, and the number of auxiliary variables becomes 
an additional measure of complexity (besides model order) that 
we call intricacy. This generalized state representation, and its 
associated graphical representation, is the system's complete 
computational structure. 

Partial structure representations were then introduced as a 
means for simplifying a system's structural description while 
retaining a complete representation of its input-output dynamic 
behavior. These included subsystem structure, signal structure, 
and sparsity structure. 

Subsystem structure was first introduced as the most re- 
fined view of the interconnection of a system's legitimate 
subsystems. This description is represented as the lower linear 
fractional transformation of a static interconnection matrix N 
with a block diagonal operator S. Its graphical representation 
is a block diagram, like the system's complete computational 
structure, that is a condensation graph with respect to a 
meaningful partition of the system's states. 

Signal structure, on the other hand, is a signal flow diagram 
of the causal dependencies among manifest variables given by 
the dynamical structure function of the system. We demon- 
strated that systems may exhibit extremely structured behavior 
in the signal structure sense while having no apparent structure 
in the subsystem or computational structure sense. Moreover, 
the transformations between manifest variables, represented as 
edges in the signal structure graph, do not necessarily partition 
the system states, as do the nodes of the subsystem structure. 
This fact implies that the minimal order to realize a particular 
signal structure may be, in fact, higher than the minimal order 
necessary to realize the transfer function specified by the given 
signal structure. 

Finally, the weakest notion of structure is sparsity structure, 
or the pattern of zero entries in the system's transfer function 
matrix, which graphically also becomes a signal flow graph 
like signal structure. We demonstrated that this representation 
is very weak, reminding readers that a diagonal transfer 
function matrix, for example, does not imply that even a 
minimal realization of the system is necessarily decoupled. 
Thus, this notion of structure really is a statement about the 
closed-loop dependencies of inputs on outputs of the system 
and much less of a statement about how those closed-loop 
dependencies came to be. 

These representations were then shown to contain differing 
levels of structural information about a system. In particular, it 
was shown that the complete computational structure uniquely 
specifies both the subsystem and signal structure of a sys- 
tem, and that either of these partial structure representations 
uniquely specify the transfer function (and thus its associated 
sparsity structure) of the system. Nevertheless, the relationship 
between subsystem and signal structure is less definitive, as 
we demonstrated that two realizations of the same system may 
share subsystem structure but have different signal structures, 



or, conversely, two realization of the same system may share 
signal structure but have different subsystem structures. These 
different representations simply appear to offer different per- 
spectives of the system's structural properties. 

We then surveyed the landscape of new problems in systems 
theory that arise when considering these partial structure 
representations. In particular, we showed that the standard 
realization problem now becomes two types of problems, a 
reconstruction problem, where a transfer function is given and 
one would like to determine a partial structure representation 
that is consistent with it, and a structure realization problem, 
where a partial structure representation is given and one would 
like to find a generalized state realizations that is consistent 
with it. Minimal versions of these problems are obtained if 
one can define a sensible notion of complexity of each kind 
of representation, and various suggestions were offered. Asso- 
ciated approximation, or model reduction problems were then 
characterized, where the target representation is simpler than 
the minimal complexity necessary to yield a representation 
that is consistent with the given model or description of the 
system. Here we note that the model reduction problems begin 
to consider structure approximation as well as approximation 
of the system's dynamic behavior, leading to a variety of new 
problems one may consider. It is our hope that many of these 
problems will be addressed in the coming years, leading to a 
more thorough and complete understanding of the meaning of 
structure and its relationship to the behavior of interconnected 
dynamic systems. 
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